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Abstract. We consider ^-Volterra quadratic stochastic operators defined on (m — 1)- 
dimensional simplex, where I G {0,1,. ..,m}. Under some conditions on coefficients of 
such operators we describe Lyapunov functions and apply them to obtain upper estimates 
for the set of u- limit points of trajectories. We describe a set of fixed points of £-Volterra 
operators. 
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1 Introduction 

A quadratic stochastic operator (QSO) has meaning of a population evolution operator 
(see [6]- [8]), which arises as follows. Consider a population consisting of m species. Let 
^) be the probability distribution of species in the initial generations, and 
Pij^k the probability that individuals in the ith. and jth species interbreed to produce an 
individual k. Then the probability distribution ^) (the state) of the species 

in the first generation can be found by the total probability i.e. 



This means that the association x° — x' defines a map V called the evolution operator. 
The population evolves by starting from an arbitrary state then passing to the state 
x' = V{x) (in the next "generation"), then to the state x" = V{V{x)), and so on. Thus 
states of the population described by the following dynamical system 



m 




(1) 



X 



.0 



X = 



V{x), x" = V^{x), X 




Note that V (defined by (1)) is a non linear (quadratic) operator, and it is higher di- 
mensional if m > 3. Higher dimensional dynamical systems are important but there are 
relatively few dynamical phenomena that are currently understood ([1],[2],[9]). 

In [11] we considered a class of nonlinear (quadratic) operators which is called £- 
Volterra operators and the difference of i- Volterra quadratic operators from known 
quadratic operators are discussed. Some invariant (in particular some fixed points) sets 
for Volterra operators are described. Also we described a family of Volterra opera- 
tors each element of which has cyclic orbits generated by several vertices of the simplex. 
It is shown that the set of all Volterra operators is convex, compact and its extremal 
points arc constructed. For 1-Volterra operators and 2-Volterra operators defined on a 
two dimensional simplex the limit behavior of all trajectories (orbits) are studied. 

In this paper we continue the investigations of £- Volterra quadratic operators. Under 
some conditions on coefficients of such operators we describe Lyapunov functions and 
apply them to obtain upper estimates for the set of uj- limit points of trajectories. We 
describe a set of fixed points of the £- Volterra operators. This paper also contains many 
remarks with comparisons of Volterra operators and Volterra ones. 



2 Definitions 

The quadratic stochastic operator (QSO) is a mapping of the simplex. 

S"^-' = |x = (xi, Xm)eR"':Xi>0,f2xi = l^ (2) 
into itself , of the form 

m 

V : Xj^= ^ ^ Pij^k^iXj, k — 1, ...,m, (3) 
where Pij^k are coefficients of heredity and 

m 

Pij,k > 0, Pij,k = Pji,k: ^ Pij,k = 1, («, j, k = 1, m). (4) 

k=l 

Thus each quadratic stochastic operator V can be uniquely defined by a cubic matrix 

P = iPij,k)lj^k=i ^i^^ conditions (4). 

Note that each element x e S'^~^ is a probability distribution on £^ = {1, m}. The 
population evolves by starting from an arbitrary state (probability distribution on E) 
X e then passing to the state V{x) (in the next "generation"), then to the state 

V{V{x)) = V^{x), and so on. 
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For a given x^^^ e S"^ ^ the trajectory (orbit) 

{a;(")}, n = 0,1,2,... of x^^^ 

under the action of QSO (3) is defined by 

^(n+i) ^ vix^""^), where n = 0, 1, 2, ... 

One of the main problem in mathematical biology consists in the study of the asymp- 
totical behavior of the trajectories. The difficulty of the problem depends on given matrix 
P. 

For the history of (particularly) studied QSOs see [10], [11]. 

The Volterra operators, {see [3]- [5]) A Volterra QSO is defined by (3), (4) and the 
additional assumption 

Pij,k^O, if k^{i,j}, Vi,j,keE. (5) 

The biological treatment of condition (5) is clear: The offspring repeats the genotype 
of one of its parents. 

In paper [3] the general form of Volterra QSO 

V:x^ (xi, e ^ V{x) = = {x[, ...,x'J e S"^-' 

is given 

^'k ^Xk(^ + Y^ dkiX-^ , (6) 

where 

Qki = 2Pik,k - 1 for i 7^ A; and an ^0,i e E. 

Moreover 

Ofei = -Ojfe and \aki\ < 1. 

In [3], [4] the theory of QSO (6) was developed by using theory of the Lyapunov 
function and tournaments. But non- Volterra QSOs (i.e. which do not satisfy the condition 
(5)) were not in completely studied. Because there is no any general theory which can be 
applied for investigation of non- Volterra operators. 

In this paper we consider the following class of non- Volterra operators. 

£- Volterra QSO. Fix £ e E and assume that elements Pij^k of the matrix P satisfy 

Py-fe = if A; ^ {i,j} for any k e {1, ...,£}, i,j G E; (7) 
Pij,k > for at least one pair (i,j), i k, j ^k if /c G {£+ 1, ...,m}. (8) 
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Definition 1. For any fixed ieE, the QSO defined by (3), (4), (7) and (8) is called 
£-Volterra QSO. 

Denote by Ve the set of all £-Volterra QSOs. 

Remarks. 1. The condition (8) guarantees that V^j C\^h — ^ ^2- 
2. Note that £-Volterra QSO is Volterra if and only if £ = m. 

4. The class of Volterra QSO for a given £ does not coincide with a class of non- 
Volterra QSOs mentioned in [10], [11]. 

3 Lyapunov functions of Volterra QSO. 

Let k e {1, ■■■,£} then Pfefe.i — ior i ^ k and 

m m 

Pkk,i — Pkk,k + ^ Pkk,i — 1- 

i=i i=e+i 



Using Pij^k = Pji,k we get for /c = 1, 

/ ™ \ / 



Xj^ — Xk 



Pkk,kXk + 2 Pik. 



kXi 



Xk 



) 



X7. 



V 



ii^k 



I 



Denote aki — '2.Pik,k — l,k ^ i and akk — Pkk,k — 1 then we obtain 

X'^ = Xkil + YALl(^kiXi) , k=l,...,i 

V : < ^ m m (9) 

Xf. = Xfe (1 + Y2i=l ^kiXi) + X/ ''.^1 Pij,kXiXj, k — £ 1, TTl. 



i^k 



Note that 



Ofcifc e [-1, 0]; \aki\ < 1; au + a^fc = 2(Pjfe,j + Pik,k) - 2 < 0, i,ke E. (10) 
Lemma 1. If3ko e {1, ...,-^} anc? 5 < suc/i ^/la^ ak^i < S for any i & E then 

^5 = |p = ipi, ■■■,Pi} e S^-^ : ^ OfeiPfe < 5, for any i e £;| ^ 0. 

Proof. It is easy to see that e^'^") = {0, ...,0,e'j^°^ = 1,0, ...,0) e Ps- Thus for suffi- 
ciently small e we have 



{peS'-':\\p-e^''°^<e}GPs, 
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where — e*^'^"^ || = maxj — e-*^"-*!- Indeed e can be chosen as follows. Takep = (pi, 
with pf,^ — l — £, Yl^i=i Pi — e then \\p — e^''°^\\ < e and 



for any i e if 



akiPk < i ^k'i ^ XI + '^'=0''^^ - ^) ^ 

fe=l I k^'k'o ) 



max {ofej, 0} - ttkoi > £ + ttkoi < S 

/cS{l,...,^} 
k^kg 



£ < mm 



ies maxfce{i,...,^}{afej,0} - a^^ 



This completes the proof. 

Let be the trajectory of the point x° e S''""^ under operator (9). Denote 

by uj{x^) the set of limit points of the trajectory. Since {x^")} C 5'"^"-'^ and 5'"^"-'^ is 
compact, it follows that uj{x^) ^ 0. Obviously, if a;(a;°) consists of a single point, then the 
trajectory converges, and lo{x^^ is a fixed point of (9). However, looking ahead, we remark 
that convergence of the trajectories is not the typical case for the dynamical systems (9). 
Therefore, it is of particular interest to obtain an upper bound for i.e., to determine 

a sufficiently "small" set containing 

Denote 

m 

int,5"*-' = {x e S"^-^ : > 0}- 

1=1 

Definition 2. A continuous function (/? : intS'"*""^ ^ it! is called a Lyapunov function 
for the dynamical system (9) if the limit lim^^oo exists for any initial point 

Obviously, if lim„_^oo V^(^''~"^) = c, then C (p^^[c). Consequently, for an upper 

estimate of a;(a;°) we should construct Lyapunov functions that are as large as possible. 

Theorem 1. If^ko G {1, such that akt^i < for any i & E and p = (pi, ...,Pi) G 
Pq then (pp{x) = Xi^...x^'^ is a Lyapunov function for (9). 
Proof. Compute ippiVx): 



Pk 



(Ppivx) =Y\xi^ ( s ) " ^p^^^ n ( ^ + X] ^^^^^ 

k=l \ i=l J fe=l \ 1=1 

Using Young's inequality 

K-^.' <Pibi + ...+Pih, 
where 6^ > and Pi > 0, Ylfi=iPi = 1 we obtain 
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ipp{Vx) < (pp{x) + ^kiPkj Xij . 

Since p E Pq we have Y^k^idkiPk < for any i E E. Consequently (p{Vx) < (p{x). 
This completes the proof. 

Theorem 2. If Uki < for any k — 1, r, (r < i) and i — r + 1, m then 

(p{x) — xi + ... + Xr, X — {xi, Xm) £ int5"^~^ 

is a Lyapunov function for (9). Moreover ^'^^Qip{x^"^) < +oo for any trajectory {x^"'^}. 
Proof. Compute (p{Vx) according (9): 

r r / m \ 

(p{Vx) = ^ 4 = (p{x) + ^lYl ) 

fe=l k=l \i=l J 

Since a^k £ [—1,0], 0^1 + a^fe < (see (10)), it follows that 

r r r 

akiXkXi = ^ akkxl + ^ (afci + aik)xkXi < 0. 

fe=l i=l k=l l<k<i<r 

Therefore, by (11) we have 

r / m \ 

(p{Vx) < (p{x) + XI ( XI "^^^^ ) ^f'- 

fc=l \i=r+l / 

Let 

a = min {-a^i}, 

ke{l,...,r} 
iG{r+l,...,m} 

since a > 0, (12) gives us 

r / m \ 

(^(l^x) < (^(x) - aX I ^ Xi\ Xk = (p{x)[l - a + a(p{x)]. (13) 

fc=l \i=r+l / 

For any ,x° G intS*™""^ we have (/9(a;°) < 1. Since a < 1, it follows 1 — a + a(p{x^) < 1. 
Therefore, it follows from (13) that the inequality 

(^(x("+')) < (^(x("))[l -a + q;(/?(x("))] < ip{x^)[l -a + q;(^(x°)]" 

holds along the trajectory {x^"-^. Thus, ip{x^"'^) — >• and also Yl'^=o'^i^^^^) < +00. 
Theorem is proved. 

It is known that if a„ and 6„ are two bounded sequences of nonnegative numbers and if 
fln+i < cin + bn, ^ = 1,2, ... then it follows from bn ^ that {a„} is dense in [lim a„, lima„]. 
Moreover, if bn < +00, then limn^^Gn exists. 



6 



Below we use this fact to construct new Lyapunov functions. 
Theorem 3. // conditions of theorem 2 are satisfied then 

iip{x) = xl\..x^\ r <e,x= {xi, ...,Xm) e int^™"^ 

is a Lyapunov function of (9) for any p — (pi, £ 'S'''"''^. 

Proof. Using Young's inequality, we get 

r / m \ / r / m 

dkiXi Pk = ipp{x) 1 + E E "'^^^^ ]pk] ■ (14) 

k=l \ i=l / \ k=l \i=l 

By conditions we have 



r m 



E E ""kiPkXi < E EE ^kiPkXi < 0. 

k=l i=l k=l k=l i=r+l 

Hence by (14) we get 

r 

i/jpix') < 'ilJp{x){l + E^fe)- 

fe=l 

Consequently, along any trajectory {x^'^^ we have 

^^^p{x^-'-'^)<^|;p{x^-^){l + cp{x^-^)l (15) 

where (^(a;*^")) = Yl^i^=i ^k'^^ ■ According to Theorem 2, the series Xl^o '/'(^ ''"'*) converges, 
and so it follows from (15) that lim„^oo V'p(a^''"''*) exists along any trajectory. 

Remark. When the functions Lpp and ipp are extended from int^*™""^ to S"^~^ the 
expression 0'^ can arise, and wc set it equal to 1. 

Now we shall describe Lyapunov functions of other forms. 

Theorem 4. // there exists p e {1, ■■■,£} and q & E such that Upi — a^j < for any 
i & E then 

fpq{x) ^, X = (xi, ...,Xm) G intS""""^ 



Xq 



is a Lyapunov functions of (9). Moreover fpq{x) is monotonically decreasing along the 
trajectory {x*^")}, where x° e int5'"^~-'^ and x^ ^ V{x^). 
Proof. We have 

f ix') = '-P-f (x) ^^=^ "P'^' (16) 

Xq ± i- 2^j=i "gi^i n- ±{g>£}X 2^ »,j=i I-^j^qX^Xj 

where l{q>e} — (resp. =1) if g < £ (resp. q > i). Clearly, 

m 

^{q>t}Xq^ E ^ii^^^i^i - ^' ^ ^ ^^^'^ 



m— 1 



Consequently, from (16) by condition of theorem we get 



fpq{x') < afpq{x), (17) 

where 

a = max < 1. 

This impUcs fpq{x^"^^^) < fpq(x^^^),n > 0. Thus sequence fpq{x^^^) is a monotonicaUy 
decreasing. Since it is bounded we conclude that fpg is a Lyapunov function. 

Remark. The Lyapunov functions mentioned in Theorems 1, 2 and 4 are mono- 
tonicaUy decreasing along any trajectory. Note that under conditions of Theorem 4 we 
can also construct the function f^{x) = ^ which is monotonicaUy increasing along any 
trajectory {x^"'^} with G int^™"^. But the limit lim^^oo /^(a;^")) can be equal to +00. 

4 Upper estimations of uj{x'^) 

In this section we shall apply the Lyapunov functions described in the previous section 
to obtain an upper bound of uj{x^). 

Denote by Fix(V) the set of all fixed points of the operator (9) i.e. 

Fix(y) ^{xe S"^-^ : V{x) = x}. 

Theorem 5. If there exists ko e {1, and S > such that ak^i < —S for any 

i e E then for x^ ^ Fix(y), 



(x°) dixeS"^-^ : J|xi = 0}. 



Proof. Consider Lyapunov function i^p{x) — HLi ^ ^s- proof of Theorem 

1 we have 

iPp{Vx) < (1 - 5)ipp{x), 5 > 0. 
Iterating this inequality we obtain (/^^(x^")) < (1 — 5Y^pp{x^). Hence 

e. 

lim (/?p(x(")) = lim n(a^rV' = 0- 

i=l 

This completes the proof. 

As a corollary of Theorem 2 we have 

Theorem 6. Suppose conditions of Theorem 2 are satisfied. If i & {l,...,r} then 
0, at the rate of a geometric progression as n 00. 
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This Theorem gives the estimation u{x^) C S'^ ^, where S"^ ^ is the face of S'^ ^ 
spanned by the vertices e^'^+i) = (0, 0, e^+i = 1, 0, 0),..., e^'") = (0, 0, 1). 

If in Theorem 4 we consider more stronger condition i.e. api — a^j < instead of 
o-pi — ciqi ^ 0, for any i E E. Then we get (17) with a < 1. In this case it foUows that 



a more precise estimate for uj{x^) : it is a subset of the simplex S"^~^ with Xp = where 
p G {1, ■■■,£} such that there exists q = q{p) G E which satisfies conditions of Theorem 4. 
By these results and results of [11] we make following remarks. 

Remarks. 1. For Voherra operators the estimate u!{x'^) C 5""^''"^ can be improved 



to the estimation cj(a;°) C dS"^ ^ ^ = {x E S"^ ^ ^ : Hi^i'^ ^ Xi = 0} (see [3]). In general, 



ii i < m then such an improvement is impossible. 

2. If i < m — 2 then ^-Volterra operators can have cyclic trajectories this is quite 
different behavior from the behavior of Volterra operators, since Volterra operators have 
no cyclic trajectories. 

3. One of the main goal by introducing the notion of Volterra operators was to give 
an example of QSO which has more rich dynamics than Volterra QSO. It is well known 
[3], [5] that for Volterra operators (see (6)) if 7^ (i 7^ j) then for any non-fixed initial 
point A° the set a;(A°) of all hmit points of the trajectory {A*^"^)} is subset of the boundary 
of simplex. But for Volterra operators, in general, the hmit set can be subset of the 
inside of simplex. 

4. It is known [3] that Volterra operators are homomorphisms. Consequently, for 
any initial point x° G S"^~^ the "negative" trajectory {y~"(x°)},n = 0,1,2,... exists. 
Moreover the negative trajectories always converge. But such kind of result is not true 
for Volterra operators. 



fpq{x^^^) —>■ 0. Using the fact that < Xq < 1, we get x'. 



in) 



0. This enables us to get 



'p 



5 The fixed points of the operator (9) 



It is easy to see that a vertex e*^*) = (0, 0, Ij, 0, 0) of S'^ ^ is a fixed point of V iff 
Pii^i — 1. We consider the question of the existence of other fixed points. 



For j e E denote 



Xj = {xeS 



m— 1 



V{x)k=Xk, k = l,...,j]. 



Note that X^_i — — Fix(y) and Xj C Xj_i for any j — l,...,m — 1. 
It is easy to see that x e X^ if and only if 



m 




(18) 



1=1 
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Set supp^x — {i & {1, : Xi ^ 0} then from (18) we get 

supp^x n supp^Ax — 0, (19) 

where A — (aij)^-^^ is m x m matrix with aij defined in section 3. 

Lemma 2. If x,y G and supp^a; = supply then Xx + {1 — X)y G for any 
AG [0,1]. 

Proof. By (19) and supp^x = supp^?/ we have 

supp^x n (supp^Ax U supp^^y) = 0. 
Since supp^(AM + (1 — A)^) C supp^w U supp^v we have 

supp£(Ax + (1 — X)y) n supp^(A74x + (1 — X)Ay) c supp^x n (supp^Ax U supp^Ay) — 0. 

Hence Ax + (1 — X)y G X^. 

For p, gr, r G -B put A = (a^^ - app)(aqr - agg) - {apr - apq)(aqr - a^p); 

^1 — ^qr^pq ^pr^qqi ^2 — ^pr^qp ^qr^pp- 

Theorem 7. // 

(a) p,q,r E E such that {p, q.r} H {£ + 1, .... m} contains at most one element, say r; 

(b) Pij,k = for anyi,j G {p,q,r},k E {i + l,...,m} \ {p,g,r}; 

(c) A ^ 0, sign(A) = sign(Ai) = sign(A2) = sign(A - Ai - As). 

Then the interior of the two-dimensional face Sp^^ spanned by the vertices e^\ e*-^-* and 
e^'^^ of S'"'^^^ contains exactly one fixed point ofV. 

Proof. Under conditions (a) and (b) the restriction of V (see (9)) to the face Sp^^. has 
the form 

1 + 

Using Xp + Xq + Xr = 1, XpXqXr > and (20) the equation V{x) = a; on Spq^. can be written 

as 

(^Ojpf. dpp^ Xp ~t~ (^Ojpf. ^pg^ — ^pvi 
iflqr ^qp) ■^p ~^ iflqr ^qq) ■^q — ^qr- 

Elementary computations show that X \^X -j^ ^ • • • 5 

1), where 

* Ai , A2 , A - Ai - A2 
^ ~ A ' ^ ~ A ' A ' 
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and all the rest of the coordinates are zero, is a fixed point of V. It follows from condition 
(c) that x*,x*,x* > 0. Therefore, x* is a fixed point satisfying the condition of the 
theorem. Uniqueness is verified by a simple computation. Theorem is proved. 
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